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O . Abstract 

(N 

The concepts of paracontracting, pseudocontracting and nonexpanding operators 
^^ , have been shown to be useful in proving convergence of asynchronous or parallel it- 

eration algorithms. The purpose of this paper is to give characterizations of these op- 
,J^ ' erators when they are linear and finite-dimensional. First we show that pseudocon- 

Cd . tractivity of stochastic matrices with respect to || • ||oo is equivalent to the scrambling 

property, a concept first introduced in the study of inhomogeneous Markov chains. 
This unifies results obtained independently using different approaches. Secondly, we 
generalize the concept of pseudocontractivity to set-contractivity which is a useful 
K*" \ generalization with respect to the Euclidean norm. In particular, we demonstrate 

non-Hermitian matrices that are set-contractive for || ■ ||2, but not pseudocontr active 



■^ ■ for II • II2 or II • I loo- For constant row sum matrices we characterize set-contractivity 

^T , using matrix norms and matrix graphs. Furthermore, we prove convergence results 

vQ \ in compositions of set-contractive operators and illustrate the differences between 

^^ ■ set-contractivity in different norms. Finally, we give an application to the global 

(— I . synchronization in coupled map lattices. 



Key words: coupled map lattice, Markov chains, nonexpanding operators, 
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1 Introduction 



Definition 1 ([1]) Let || ■ \\ he a vector norm in C". An n by n matrix B is 
nonexpansive with respect to || ■ || if 

VxgC",||5x|| < ||x|| (1) 
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B is called paracontracting with respect to || ■ || if 

yxeC''\Bx^x^\\Bx\\ <\\x\\ (2) 

It is easy to see that normal matrices with eigenvalues in the unit circle and 
for which 1 is the only eigenvalue of unit norm is paracontractive with respect 

to II ■ II2. 

Definition 2 For a vector x G C" and a closed set X* , y* is called a projec- 
tion vector of x onto X* if y* G X* and 

\\x — y*\\ = min ||x — yll 

yeX* 

The distance of x to X* is defined as d{x,X*) = \\x — -P(a;)|| where P{x) is a 
projection vector of x onto X* . 

Even though the projection vector is not necessarily unique, we write P{x) 
when it is clear which projection vector we mean or when the choice is im- 
material. Let us denote e= (I,--- ,1)^- The proof of the following Lemma is 
relatively straightforward and thus omitted. 

Lemma 1 If x E M" and X* = {ae : a G M}, the projection vector P{x) of x 
onto X* is ae where: 



• for the norm || ■ II2; a = ^ Si ^i and d{x, X*) = yJ2i i^i — a) . 

• for the norm ||-||oo; « = | (maXjXj + minjXj), andd{x, X*) = | (maXjXj — minjXj) 

• for the norm \\ ■ \\i, d{x,X*) = J2i=\2.]+i^i ~ J2i=i ^i and 
■ for n odd, a = xp-| . 

• for n even, a can be chosen to be any number in the interval [znjXn+i]. 

Here Xi are the values Xi rearranged in nondecreasing order Xi < X2 < ■ ■ ■ ■ 

The property of paracontractivity is used to show convergence of infinite prod- 
ucts of paracontractive matrices and this in turn is used to prove convergence 
in various parallel and asynchronous iteration methods [2]. In [3] this property 
is generalized to pseudocontractivity. 

Definition 3 ([3]) Let T be an operator on M". T is nonexpansive with re- 
spect to II ■ II and a closed set X* if 

VxGM",a:* G ^MlTx - a:*|| < ||x-x*|| (3) 

T is pseudo contractive with respect to \\ ■ \\ and X* if it is nonexpansive with 
respect to \\ ■ \\ and X* and 

\/x^X*,d{Tx,X*) <d{x,X*) (4) 



Ref. [3] shows that there are pseudocontractive nonnegative matrices which 
are not paracontractive with respect to || • ||oo and proves a result on the 
convergence of infinite products of pseudocontractive matrices. Furthermore, 
Ref. [3] studies a class of matrices for which a finite product of matrices from 
this class of length at least n — 1 is pseudocontractive in || ■ ||oo- 

The purpose of this paper is multifold. First we show that for stochastic matri- 
ces with respect to || ■ ||oo and X* = {ae : a G M}, pseudocontractive matrices 
are equivalent to scrambling matrices and thus are simply characterized. The 
concept of scrambling matrices is first introduced in the study of weak ergod- 
icity in inhomogeneous Markov chains and this equivalence allows us to unify 
several results obtained independently using these different concepts. 

The second goal of this paper is to generalize pseudocontractivity by intro- 
ducing the concept of set-contractivity. We prove a convergence result of set- 
contractive matrices and show existence of set-contractive matrices in || ■ II2 
that are not pseudocontractive with respect to || • II2 or || ■ ||oo- We study set- 
contraction with respect to || ■ II2 in terms of matrix norms and graphs of 
matrices. 

Finally, we apply these results to the global synchronization of coupled map 
lattices. 

We concentrate on the case where T are matrices and X* is the span of the 
corresponding Perron eigenvector. If the Perron eigenvector is strictly positive, 
then as in [3], a scaling operation T -^ W~^TW where W is the diagonal 
matrix with the Perron eigenvector on the diagonal, transforms T into a matrix 
for which the Perron eigenvector is e. Therefore in the sequel we will focus on 
constant row sum matrices with X* = {ae : a eM.}. 



2 Pseudocontractivity and scrambling stochastic matrices 



Scrambling matrices were first defined in [4] to study weak ergodicity of inho- 
mogeneous Markov chains. 

Definition 4 A matrix A is scrambling if for any pair of indices i,j, there 
exists k such that Aik 7^ and Ajk 7^ 0. 

Definition 5 For a real matrix A, /i(A) is defined as 

li{A) = min^min(Ajj, Ah) 



For nonnegative matrices with row sums < r, it is clear that < fi{A) < r 
with IJ,{A) > if and only if A is scrambling. 

Definition 6 For a real matrix A, define S{A) > as 

S{A) = max Vmax(0, Aik - Ajk) > max(Afc - Ajk) 



If A has constant row sums, then S{A) = | maxjj J2k \Aik ~ Ajk\. 

Theorem 1 If A is a matrix where each row sum is equal to or less than r, 
then 6{A) < r-/i(yl). 

Proof: Ref. [5] proved this for the case of stochastic matrices and the same 
proof applies here. □ 

Theorem 2 If A is a real matrix with constant row sums and x G M", then 
maxj yi — miuj yi < S{A) (maxj Xi — miuj Xi) where y = Ax. 

Proof: The proof is similar to the argument in [5]. Let Xmax = niaxj Xi, Xmin = 
mini Xi, ymax = max, yi, y^am = min, yi. 

?/max ?/min ^ maXjj- 2^^^ (^^ife -^jk) ^k 

< maxjj- (Efe max (0, Aik - Ajk) x^ax + Efe min (0, Aik - Ajk) x^in) 

(5) 
Since A has constant row sums, J2k Aik — Ajk = 0, i.e. 

Y^ max (0, Aik - Ajk) + Y^ min((0, Aik - Ajk) = 

k k 

This means that 

Uvciax 1/min S maXj j [2^k maX [U, Aik ^jk)) i^max ^minj , , 

(6) 

Ji ^\Aj (^iCjiiax XjiiinJ 

D 

The following result shows that pseudocontractivity of stochastic matrices 
with respect to || ■ ||oo is equivalent to the scrambling condition and thus can 
be easily determined. 

Theorem 3 Let A be a stochastic matrix. The matrix A is pseudocontractive 
with respect to || • ||oo and X* = {ae : a G M"} if and only if A is a scrambling 
matrix. 

Proof: Let x* G X*. Then Ax* = x* and thus \\Ax — x*\\oo = \\A{x — x*)\\^ < 
||a:— a;*||oo- Thus all stochastic matrices are nonexpansive with respect to || ■ ||oo 



and X* . Suppose A is a scrambling matrix. Then /i(A) > 0, and 5{A) < 1 by 
Theorem 1. By Lemma 1 and Theorem 2, ^4 is pseudocontractive. Suppose A 
is not a scrambhng matrix. Then there exists z j' such that for each k, either 
Aik = or Ajk = 0. Define x as x^ = 1 if An. > and x^ = otherwise. Since 
A is stochastic, it does not have zero rows and thus there exists k' and k" 
such that Aik' = and Aik" > 0. This means that x ^ X*. Let y = Ax. Then 
Hi = 1 and yj = 0. This means that maxj yi — miuj yi> 1 = maxj Xi — miuj Xi, 
i.e. A is not pseudocontractive. □ 

With Theorem 3 several results which were shown independently can now be 
seen to be equivalent. For instance, in [6] it was shown that for stochastic ma- 
trices with positive diagonal entries and whose interaction digraph ^ contains a 
spanning directed tree a finite product of n — 1 or more such matrices is scram- 
bling. In [7] it was shown that such matrices are irreducible or 1-reducible^ 
and this result in [6] then mirrors Proposition 3.3 in [3]. 

In [8] the convergence of a class of asynchronous iteration algorithms was 
shown by appealing to results about scrambling matrices. In [3] this result 
is proved using the framework of pseudocontractions. Theorem 3 shows that 
these two approaches are essentially the same. 



3 Set-nonexpansive and set-contractive operators 



Consider the stochastic matrix 



A 



^0.5 0.5^ 



0.5 0.5 
0.5 0.5 



^ The directed graph of a square matrix A is defined as the graph with an edge 
from vertex i to vertex j if and only if Aij ^ 0. The interaction digraph of a matrix 
A is obtained from the directed graph of A by reversing the orientation of all the 
edges, i.e. it is the graph of A^ . 
^ A matrix is 1-reducible if after simultaneous row and column permutation it can 



/Sn B 



be written in the form 



12 



\ 



B22 B: 



23 



such that Bii are irreducible and for 



V Bkk J 

each i < k, there exists j > i such that Bij ^ 0. 



The matrix A is not pseudocontractive with respect to the Euchdean norm 
II ■ II2 and X* = {ae : a G M} since ||yl||2 = 1.088 > 1. On the other hand, A 
satisfies Eq. (4) ^ . This motivates us to define the following generalization of 
pseudocontractivity: 

Definition 7 Let X* be a closed set in M". An operator T on M" is set- 
nonexpansive with respect to \\ ■ \\ and X* if 

Vx G W\ d{Tx, X*) < d{x, X*) 

An operator T on M" is set-contractive with respect to \\ ■ \\ and X* if it is 
set-nonexpansive with respect to \\ ■ \\ and X* and 

Vx ^ X\ d{Tx, X*) < d{x, X*). 

The set-contractivity of an operator T is defined as 

, , d(Tx,X*) 

c{T) = sup ;, '^^/ > 
x^x* d{x,X*) 

There is a dynamical interpretation to Definition 7. If we consider the operator 
T as a discrete-time dynamical system, then T being set-nonexpansive and 
set-contractive imply that X* is a globally nonrepelling invariant set and a 
globally attracting set of the dynamical system respectively [9]. 

Lemma 2 T is set-nonexpansive with respect to \\ ■ \\ and X* if and only 
if T{X*) C X* and c(T) < 1. If T is set-contractive with respect to \\ ■ \\ 
and X* , then the fixed points of T is a subset of X*. If Ti{X*) C X*, then 
c{T,oT2)<c{T^)c{T2). 

Proof: The first statement is true by definition. The proof of the second state- 
ment is the same as in Proposition 2.1 in [3]. Suppose Ti{X*) C X* . Let 
X ^ X*. If T2(x) e X*, then d{Ti o T2(x),X*) = 0. If T2(a;) ^ X*, then 
d{T, o T2ix)) < c(Ti)(/(T2(x), X*) < c(Ti)c(T2)(i(a;, X*). D 

Lemma 3 Let X* be a closed set such that aX* C X* for all a eM.. If T is 
linear and T{X*) C X* , then c(T) = supy^n^i p(^)=o ^(^(^)?^*)- 

Proof: Let e = sup||^||=i^p(^)=o ^(^(a^)' ^*)- Clearly e < c{T). For x ^ X*, 
is a projection vector of x — P{x). Since T{P{x)) G X*, this implies that 
d{T{x),X*) = d{T{x - P{x)),X*) < e\\x - P{x)\\ = ed{x,X*), i.e. e > c{T). 
D 

Lemma 4 Let X* be a closed set such that aX* C X* for all « G M. An 



This can be shown using Theorem 6. 



set-nonexpansive matrix T is set- contractive with respect to X* if and only if 
c{T) < 1. 

Proof: One direction is clear. Suppose T is set-contractive. By compactness 



sup d{T{x),X'' 

\\x\\=l,P{x)=Q 



e< 1 



and the conclusion follows from Lemma 2 and Lemma 3. 



D 



If T is nonexpansive with respect to || ■ || and X*, then 

\\Tx - PiTx)\\ < \\Tx - P{x)\\ < \\x - P{x)\\ 

and T is set-nonexpansive. Thus set-contractivity is more general than pseudo- 
contractivity. However, they are equivalent for stochastic matrices with respect 
to II ■ lloo and X* = {ae : a G M}. 

Lemma 5 With respect to || ■ ||oo (ind X* = {ae : a G M}, a stochastic matrix 
T is pseudocontractive if and only if it is set- contractive. 

Proof: Follows from the fact that a stochastic matrix is nonexpansive with 
respect to || ■ ||oo and X* = {ae : a G M}. □ 



Definition 8 ([10]) A vector norm 



< 



on M" is monotone if 



{yi,--- ,yn) 



for all Xi and yi such that \xi\ < \yi\. A vector norm 
monotone if 



on 



is weakly 



\-^It''' 5 -^fc— 1) U, Xfc_|_i, ■ ■ ■ ,Xn) 



< 



yXi , ■ ■ ■ , x/j—i, x/j, Xfc-|_x, ■ ■ ■ , Xfi) 



for all Xi and k. 



The next result gives a necessary condition of set-contractivity of a matrix in 
terms of its graph. 

Theorem 4 Let A be a constant row sum matrix with row sums r such that 
kl ^ 1- //^ is set- contractive with respect to a weakly monotone vector norm 
II ■ II and X* = {ae : a G M}, then the interaction digraph of A contains a 
spanning directed tree. 

Proof: If the interaction digraph A does not have a spanning directed tree, it 
was shown in [7] that after simultaneous row and column permutation, A can 



be written as a block upper triangular matrix: 



A 



( 

* 


* 


* 


*1 






* 


* 






Al 





\ 






A2) 



where * are arbitrary entries and A\ and A2 are m\ by m\ and m2 by va2 square 
irreducible matrices respectively. Define x = (0, . . . , 0, — aiei, 0262)"^ ^ X*, 
where ei and 62 are vectors of all I's of length rrii and 7112 respectively. Let 
z = (0, . . . , 0, 63)"^ where 63 is the vector of all I's of length nii + 777-2 and 
Z* = {az : a G M}. Note that the set of projection vectors of a fixed vector 
X to Z* is a convex connected set. Let az be a projection vector of x to Z*. 
Suppose that for oi = 02 7^ 0, a 7^ 0. Since —az is a projection vector of —x 
to Z* and a (or at least a choice of a) depends continuously on oi and 02, by 
varying ai to — Oi and varying 02 to —02, a changes to —a. This means that 
we can find Oi and 02 not both zero, such that is a projection vector of x to 
Z*. In this case x ^ X* and by weak monotonicity d{x, Z*) = d{x, X*) = \\x\\. 
It is clear that y = Ax can be written as 



/ 



\ 



— roiei 
ra2e2 



Let f5e be a projection vector of y onto X*. By the weak monotonicity of the 
norm, 

/ ^ 



d{y,X*) = \\y-/3e\\> 

[-rai - I3)ei 
y (ra2 - /3)e2 ^ 
Since is a projection vector of x onto Z 




d{y,X*) > \r\d{x,Z*) > d{x,X*) 
Thus A is not set-contractive. 



D 



3. 1 max-norm 

Theorem 5 Let A he a matrix with constant row sum r. Then c{A) = r—n{A) 
with respect to \\ ■ ||oo and X* = {ae : a E M}. In particular, the matrix A is 
set-nonexpanding with respect to || ■ ||oo and X* = {ae : a G M} if and only 
if r — /u(yl) < 1. The matrix A is set- contractive with respect to \\ ■ ||oo and 
X* = {ae : a eR} if and only if r - ^{A) < 1. 

Proof: c{A) < r — fi{A) follows from Lemma 1, Theorem 1 and Theorem 2. 
Since c{A) > 0, c{A) = r — fJ^{A) if r — ^(A) = 0. Therefore we assume that 
r — iJ-iA) > 0. Let j and k be such that fi{A) = J2i^^ i^jii ^ki) ■ Define x 
such that Xi = 1 ii Aji < Aki and Xj = otherwise. Since r — fi{A) > 0, a; is 
not all O's or all I's, i.e. x ^ X*. Let y = Ax. Then by Lemma 1 

2(i(y, X*) >yk-yi = Ei,AJ^<Ak^ ^ki - Aji 

= l^i Aki — l^i,Aji>Ak, ^ki — l^i,Aji<Aki Aji 

= r - ii{A) 
Since 2d{x, X*) = l, it follows that c{A) > r - ^{A). D 



3.2 Euclidean norm 



The following result characterizes set-contractivity of matrices with respect to 
II ■ II 2 in terms of matrix norms. 

Theorem 6 Let A be an n by n constant row sum matrix and K be ann by n— 
1 matrix whose columns form a orthonormal basis ofe-^. Then c{A) = ||y4X||2 
with respect to || ■ II2 and X* = {ae : a eM.}. In particular 1174X112 — ^ ^/ ^''^^ 
only if A is set-nonexpanding with respect to \\ ■ II2 and X* = {ae : a G M}. 
Similarly, WAKW^ < I if and only if A is set- contracting with respect to \\ ■ II2 
and X* = {ae : a eR}. 

Proof: Define J = ee^ as the n by n matrix of all I's. Note that ||2;||2 = ||i^2;||2 
and JiC = 0. Let S = A - ^ J. Then 

n 

JIAKjU = JI-BKjU = max JlSii'xIU = max ||i?i^x||2 = max ll-BxIU 

' ' ' 1 1 1 1 -1 ' II T^ II ^ I 1 1 1 1 1 

||a;||2=l ||K2;||2=1 a::±e,||x||2=l 

By Lemma 1 P[x) = -Jx and d{Ax,X*) = ||-Ba;||. Since A has constant row 
sums, A{X*) C X* and by Lemma 3 c{A) = maxp(2.)=o,||x||2=i (^(^^i^*) = 
maxp(^)=o,||x||2=i ll-^2;||2. Since P{x) = if and only if X-Le, this means that 
c{A) = \\AK\\^. D 



3.3 weighted Euclidean norm 



Definition 9 Given a positive vector w, the weighted 2-norm \\ ■ ||^ is defined 
as 



iki 



E 



WiXf 



Theorem 7 Let A be an n by n constant row sum matrix and K be as 
defined in Theorem 6. Let w be a positive vector such that maxj wi = 1 
and W = diagiw). Then c{A) < W^ AW~^K with respect to \\ ■ ||^ and 
X* = {ae:ae M}. 



Proof: The proof is similar to Theorem 6. Define Jw = ^ — and B = A — 3,^}- 
Note that IM-^K = 0. Then 



\W^AW-^K\\2 



\\W'2BW-^K\\2 

max||i^a;||2=i ||VF2i?14/"ii^x||2 
\W^BW-^x\\2 



UiaXx±e, \\x\\2=l 



Now X-Le if and only if W ^X-Lw. Since ||a;||2 = \\W 2x||^, this means that 



W2AW-'K\\2 = max 



that llW^ao;! 



'x±w,\\W'^x\\iu=l 



\W2Bx\\2- Since maxji^j = 1, this means 



J2i{'^i^iy ^ II^IU ^'^'^ thus 



\W^AW-^K\\2 > max \\W^Bx\\2 

xXw,\\x\\-uj=l 



It is straightforward to show that P{x) = J^x and thus d{Ax, X*) = ||i?a;||^ = 
||W^2_Bx||2. Since A has constant row sums, A{X*) C X* and by Lemma 3 
c{A) = maxp(^)=o,||x|U=i d{Ax, X*) = maxp(^)=o,||x|U=i W^Bx Since P{x) = 



if and only if X-Lw, this means that c{A) < 



W^AW-^K 



u 



Note that the matrix A in Theorem 5, Theorem 6 and Theorem 7 is not 
necessarily nonnegative or stochastic. 



10 



3-4 examples 



The matrix 



A, 



^ \.\ 0.0 0.0^ 

0.6 0.5 
yO.6 0.5 y 



is set-contracting with respect to || ■ ||oo and X* = {ae : a G M} since /u(^i) = 
0.6 and c{Ai) = 1.1 — /i(Ai) = 0.5 < 1. It is not pseudocontracting with 
respect to || ■ ||oo and X* = {ae : a eM.} since ||Ai||oo = 1-1 > 1- 



The stochastic matrix 



'^0.4 0.3 0.3^ 



A, 



1 
1 



is set-nonexpanding with respect to || ■ II2 and X* = {ae : a G M} since || A2i^||2 
1 but it is not nonexpanding with respect to || ■ II2 and X* = {ae : a E M.} 
since IIA2II2 > 1- Furthermore, Theorem 4 shows that A2 is not set-contractive 
with respect to any weakly monotone norm and X*. 



The stochastic matrix 



A, 



'^ 1 ^ 

0.5 0.5 
y 0.5 0.5 y 



is set-contractive with respect to || ■ II2 and X* = {ae : a G M} since || ^3^112 = 
0.939. Since IIA3II2 > 1 it is not nonexpanding nor pseudocontractive with 
respect to || ■ II2 and X*. It is also not pseudocontractive with respect to || ■ ||oo 
and X* since it is not scrambling. 



The stochastic matrix 



^10 0^ 



A, 



0.9 0.1 
0.1 0.1 0.8 



has an interaction digraph that contains a spanning directed tree. However, 
it is not set-nonexpanding with respect to || ■ II2 and X* = {ae : a G M} since 



\A.K\ 



1.125 > 1. This shows that the converse of Theorem 4 is not true 



for II ■ II 2. ^ On the other hand, A4 is set-contractive with respect to 



and 



^ Theorem 3 shows that the converse of Theorem 4 is false as well for stochastic 
matrices with respect to || • ||oo and X*. 



11 



X* since A^ is a scrambling matrix. Furthermore, A4 is set-contractive with 
respect to || ■ ||^ and X* for w = (1,0.2265,1)'^ since WW^A^W-^K^ < 1. 

Next we show some convergence results for dynamical systems of the form 
x{k + 1) = Tkx{k) where some T^'s are set-contractive operators. 

Theorem 8 Let {T^} be a sequence of set-nonexpansive operators with respect 
to II ■ II and X* and suppose that 

\imYlc{n)=0 

k 

Let x{k + 1) = Tkx(k). For any initial vector x(0), limfe„+oo d{x{k), X*) = 0. 

Proof: From Lemma 2, c(J\k Tk) < Yik c(Tk) ^ as A; —^ 00 and the conclusion 
follows. □ 

Theorem 9 Let X* = {ae : a G M} and {Aj.} be a sequence of n by n con- 
stant row sum nonnegative matrices such that 

• the diagonal elements are positive; 

• all nonzero elements are equal to or larger than e; 

• the row sum is equal to or less than r. 

If r"~^ — e"""*^ < 1 and for each k, the interaction digraph of Ak contains a 
spanning directed tree, then\im.k^^d{x{k),X*) = where x{k + l) = Akx{k). 

Proof: As discussed above, products of n — 1 matrices Aj^ is scrambling. By 
definition, since each A^ has nonzero elements equal to or larger than e, the 
nonzero elements of this product, denoted as P, will be equal to or larger than 
e"~^ This means that fi{P) > e"""*^ and thus 6{P) < r""-*^ — e"""*^ < 1 since 
P has row sums < r"~^. Therefore P is set-contractive with respect to || ■ ||oo 
and X* with c{P) < r"~^ — e"~^ < 1. The result then follows from Theorem 
8. □ 

The following result shows existence of linear operators B^ and vectors xl G 
X* such that x{k + 1) = Bkx{k) + x^ has the same dynamics as x{k + 
1) = Tkx{k). In particular, for y{k + 1) = Bky{k) and x{k + 1) = Tkx{k), 
d{y{k),X*) = d{x{k),X*) for all k. 

Theorem 10 T is a set-nonexpansive operator with respect to || ■ ||oo and 

X* = {ae : a eM.} if and only if for each x E MJ^ there exists a stochastic 
matrix B and a vector x* G X*such that T{x) = Bx + x* . 

T is a set- contractive operator with respect to || ■ ||oo (md X* = {ae : a G M} 
if and only if for each x G M" there exists a scrambling stochastic matrix B 
and a vector x* G X* such that T(x) = Bx + x* . 



12 



Proof: One direction of both statements follows from Theorem 3. Suppose T 
is set-nonexpansive and fix x G M". Define x* = P{T{x)) — P{x) which is a 
vector in X* . Let y = T{x) — x*. Then P{y) = P{T{x)) — x* = P{x) and by 
Lemma 1, 

min Xi < min yi < max yi < max Xi 

i i i i 

and thus there exists a stochastic matrix B such that Bx = y. 

If T is set-contractive, then for x G X*, we can choose B = -ee^ and T(x) — 
Bx G X*. For x ^ X*, d{x, X*) < d(T{x),X*). Define x* and y as before and 
we see that 

min Xi < min y^ < max yi < max Xi 

i i i i 

If Xj' = miuj X, then it is clear that we can pick B with Bx = y such that the 
i'-th column of B is positive, i.e. B is scrambling. □ 

It can be beneficial to consider set-contractivity with respect to different 
norms. For instance, consider x{k + 1) = Akx{k) where A^ are matrices that 
are not pseudocontractive with respect to || ■ ||oo and X* = {ae : a eM} and 
whose diagonal elements are 0. Since the diagonal elements are not positive, 
the techniques in [3] cannot be used to show that products of Ak are pseu- 
docontractive with respect to || ■ ||oo and X* = {ae : a G M}. However, it is 
possible that A^ are set-contractive with respect to a different norm and thus 
convergence of x{k) can be obtained by studying set-contractivity using this 
norm. For instance, the stochastic matrix 



A 



^ 0.5 0.5^ 

1 
yO.5 0.5 J 



has zeros on the diagonal and is not pseudocontractive with respect to || ■ ||oo 
and X* = {ae : a G M} since A is not scrambling. On the other hand, A is 
set-contractive with respect to || ■ II2 and X* = {ae : a eM.} since ||AK||2 = 
0.939 < 1. 

For a set of constant row sum matrices A^ and x{k + 1) = Akx{k), a lower 
bound for the exponential rate at which x{k) approach X* = {ae : a G M} is 
—\n{c{A)). The above examples show that there are matrices for which this 
rate is for || ■ ||oo and positive for || ■ II2 and other matrices for which the rate 
is positive and for || ■ ||oo and || ■ II2 respectively. 

On the other hand, even though set-contractivity depends on the norm used, 
the equivalence of norms on R" and Lemma 4 provides the following result. 

Theorem 11 Let X* be a closed set such that aX* C X* for all a G M. and 
let H be a compact set of set- contractive matrices with respect to || ■ |L and X* . 
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Then there exists m such that a product of m matrices in H is set- contractive 
with respect to || ■ ||g. 

Corollary 1 Let H he a compact set of stochastic set- contractive matrices 
with respect to || ■ ||p and X* = {ae : a G M}. Then a sufficiently long product 
of matrices in H is scrambling. 



4 Weak ergodicity of inhomogeneous Markov chains 



In Section 2 we noted the connection between set-contractivity with respect 
to II ■ lloo and weak ergodicity in inhomogeneous Markov chains. In this section 
we elaborate on this connection. A sequence of stochastic matrices Ai is weakly 
ergodic if for each r, 5 {A^Ar+i ■ ■ ■ A^+k) ^ as A; ^ oo. 

In [11] a coefficient of ergodicity is defined as a continuous function /i on the 
set of n by n stochastic matrices such that < /i(A) < 1. A coefficient of 
ergodicity /i is proper if 

^{A) = \ <^ A = ev'^ for some probability vector v. 



Seneta [11] gives the following necessary and sufficient conditions for weak 
ergodicity generalizing the arguments by Hajnal. 

Theorem 12 Suppose /ii and /i2 are coefficients of ergodicity such that /ii is 
proper and the following equation is satisfied for some constant C and all k, 

k 

1 - k^iiSA ■■■Sk)<cf[{l- fi2{S,)) (7) 

where Si are stochastic matrices. Then a sequence of stochastic matrices Ai is 
weakly ergodic if there exists a strictly increasing subsequence {ij} such that 

oo 

5]^2(A,^+i---A^,+J = oo (8) 

i=i 

Conversely, if Ai is a weakly ergodic sequence, and /ii, fi2 are both proper 
coefficients of ergodicity satisfying Eq. (7), then Eq. (8) is satisfied for some 
strictly increasing sequence {ij}. 

Define H as the set of stochastic matrices that are set-nonexpansive with 
respect to a norm || ■ || and X* = {ae : a G M}. For || • ||oo, H is the set of 
stochastic matrices. Let us define iic{A) = 1 — c{A). Then fic is a proper 
coefficient of ergodicity when restricted to H. This can be seen as follows. 
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Clearly < fic{A) < 1. If A = ev'^, then Ax e X* and thus c{A) = and 
fic{A) = 1. li A ^ ev'^, then there exists i,j, k such that Ai^ 7^ Aj^. Let x be 
the k-th unit basis vector. Then {Ax)i 7^ {Ax)j, i.e. d{Ax,X*) > 0, c{A) > 
and ^c(^) < 1- By choosing /ii = /i2 = /ic, Eq- (7) is satisfied with C = 1 by 
Lemma 2. Thus we have shown that a sufficient and necessary condition for a 
sequence of matrices in H to be weakly ergodic is 

00 

J2'^-c{Ai^+i---Ai^^J = 00 

i=i 

for some strictly increasing subsequence {ij}. 



5 Application to the synchronization of coupled map lattices 

Coupled map lattices [12] have been studied extensively and have been shown 
to exhibit complex behavior [13,14]. Recently, synchronization in coupled map 
lattice has attracted considerable attention [15,16,17,18,19]. We show here how 
set-contractivity can be useful in studying synchronization in coupled map 
lattices. 

Given a map fk '■ ^ ^ ^, consider state variables Xj G M which evolve 
according to ft at time k: Xi{k + 1) = fk{x{k)). By coupling the output of 
these maps we obtain a coupled map lattice where each state evolves as: 

Xi{k + 1) = ^aij{k)fk{xj{k)) 
j 

This can be rewritten as 

x{k + 1) = AkFk{x{k)) (9) 

where x{k) = {x,{k), ..., Xn{k)f e M" and Fk{x{k)) = (fk^k)), ..., fk{x„{k))f. 
We assume that Ak is a constant row sum matrix for all k. The map fk depends 
on k, i.e. we allow the map in the lattice to be time varying. Furthermore, 
we do not require Aj^ to be a nonnegative matrix. We say the coupled map 
lattice in Eq. (9) synchronizes if lim^t^oo \xi{k) — Xj{k)\ = for all i and j, i.e. 
x{k) approaches the synchronization manifold X* = {ae : a G M} as A; ^ 00. 
If the row sum of Ak is 1, then this means that at synchronization, each state 
Xi in the lattice exhibits dynamics of the uncoupled map fk, i.e. if x{h) G X*, 
then for all k > h, x{k) G X* and Xi{k + 1) = fk{xi{k)). 

We are now ready to state our synchronization result: 

Theorem 13 Let pk he the Lipschitz constant of fk- If lim.k->oo Yik c{Ak) pk = 
0, where c{Ak) is the set-contractivity with respect to X* = {ae : a G M} and 
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a monotone norm, then the coupled map lattice in Eq. (9) synchronizes. 

Proof: 

\\Fk{x{k)) - P{Fk{x{km < \\Fk{x{k)) - Fk{P{x{km < pk\\x{k) - P{x{k)\\ 

where the last inequahty follows from monotonicity of the norm. This implies 
that c(Ffe) < pk and the result follows from Theorem 8. □ 

Thus we can synchronize the coupled map lattice if we can find matrices A^ 
and a norm such that the contractivities c{Ak) are small enough. 

Corollary 2 Let pk be the Lipschitz constant of fk- Ifsupj.r{AK) — p{Ak) — 
— < 0, then Eq. (9) synchronizes^ . 

Proof: Follows by applying Theorem 13 to set-contractivity with respect to 

II • lU. □ 
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